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1.  Signal  Extrapolation 

A  problem  often  encountered  in  practice  is  that  of  extending  a  signal  beyond  the 
interval  over  which  it  is  observed.  Singular  Value  Decomposition  (SVD)  provides  a 
means  for  determining  the  solution  using  the  truncated  Moore-Penrose  inverse.  However, 
this  approach  requires  a  large  amount  of  computation  and  there  is  some  uncertainty  as 
to  where  the  truncation  should  occur.  We  have  derived  an  explicit  expression  for  the 
mean  square  error,  thus  providing  a  guide  for  proper  truncation.  We  also  showed  that 
decimation  can  be  applied  in  the  extrapolation  problem  to  reduce  the  high  computation 
load  without  degrading  the  extrapolation  performance  [j6,c9,cll]. 

The  ill-posed  nature  of  sub-Nyquist  rate  for  signal  reconstruction  is  studied  [j  15]. 
Conjugate  gradient  method  for  solving  linear  equations  are  attractive  in  such  applica¬ 
tions  as  signal  extrapolation,  because  of  its  fast  convergence  relative  to  other  descent 
methods.  Another  conjugate  direction  method,  known  as  A-minimal  iterations,  is  exam¬ 
ined  and  shown  to  be  more  robust  in  the  presence  of  noise  [cl5]. 


2.  Solving  Two  Dimension  Toeplitz  Systems 

Perhaps  the  most  important  statistical  signal  processing  task  is  that  of  linear  mean 
square  filtering,  which  in  the  stationary  case,  leads  to  the  familiar  Yule- Walker  equation 
of  the  form:  R  x  =  y,  where  the  correlation  matrix  R  is  Hermitian  and  Toeplitz.  Clas¬ 
sical  methods  requires  0(N 3),  where  NxN  is  the  size  of  the  matrix.  Several  0(N2) 


algorithms,  due  to  Levinson  and  others,  are  known.  In  the  two  dimensional  case  R  is  a 
Toeplitz-block  Toeplitz  matrix,  consisting  of  an  NxN  Toeplitz  arrangement  of  blocks, 
each  of  which  is  an  MXM  Toeplitz  matrix.  The  Levinson  and  Burg  algorithms  are  not 
applicable  to  a  Toeplitz-block  Toeplitz  matrix.  A  method  proposed  by  us  recently  [j  14] 
solves  the  Toeplitz  system  in  two  dimensions  using  the  data  directly  without  having  to 
estimate  the  correlation  coefficients  first.  The  total  number  of  computation  count  is 

3 

— 7V2Af3,  a  25%  reduction  from  the  previous  methods. 

4 

k 

3.  Computation  of  Minimum  Eigenvalue  and  Harmonic  Retrieval ' 

An  iterative  algorithm  of  finding  the  minimal  eigenvector  of  a  symmetric  matrix, 
which  is  applicable  in  adaptive  methods,  is  developed.  The  required  computation  is 
O(nlogn)  multiplications  per  iteration  using  the  FFT  [cl2].  One  of  the  apparent  draw¬ 
backs  to  eigenstructure-based  (Pisarenko)  spectrum  estimation  is  the  tendency  of  the 
resultant  eigen-polynomial  to  have  extraneous  roots  on  the  unit  circle  when  the  auto¬ 
correlation  matrix  is  overdetermined.  A  complete  eigenvector  decomposition  is  computa¬ 
tionally  expensive.  It  is  shown  that  good  result  can  be  obtained  by  simply  subtracting  a 
small  perturbation  from  the  (0,0)  element  of  R  prior  to  finding  the  minimum  eigenvector 
[cl  6]. 

Recent  works  have  described  the  application  of  gradient  search  techniques  and 
iterative  eigenvalue  algorithms  to  the  problem  of  implementing  Pisarenko  Harmonic 
Retrieval  in  an  adaptive  setting.  New  rotational  search  algorithms  have  been  applied  by 
us  for  the  same  problem  and  have  resulted  in  roughly  a  2/3  saving  in  computation  over 
previous  approaches  [J8] . 

4.  Adaptive  Signal  Processing 

Adaptive  signal  processing  has  been  applied  to  a  wide  range  of  problems,  including 
the  suppression  of  interference  in  radar  processing,  anti-jamming,  and  equalization  of 
communication  channels.  The  steady  state  output  error  of  the  most  commonly  used 
least  mean  square  (LMS)  adaptive  algorithm  due  to  the  use  of  finite  precision  arithmetic 
is  analyzed  [j5,c6].  When  a  multiple  of  processors  is  used  to  implement  the  LMS  adap¬ 
tive  algorithm  in  order  to  obtain  high  throughput  rate,  the  response  is  often  not  immedi¬ 
ate  due  to  pipelining  and  other  factors  A  delayed  gradient  estimate  LMS  algorithm  is 
investigated  (j  12], 


-  3  - 


The  implementation  of  adaptive  equalizers  can  be  simplified  significantly  by  employ¬ 
ing  a  finite-bit  power-of-two  quantizer  multiplier  in  which  one  multiplicant  is  converted 
to  a  ’word’  with  a  single  ’one’,  hence  reducing  a  multiplication  to  a  mere  shift.  It  is 
shown  that,  in  spite  of  its  very  simple  implementation,  the  performance  is  comparable  in 
many  cases  with  the  use  of  full  multipliers  (j9,cl4j. 

The  major  drawback  of  the  well  known  least  mean  square  adaptive  algorithm  is  its 
slow  convergence  when  the  input  autocorrelation  matrix  has  a  large  eigenvalue  spread.  A 
small  step  size  would  result  in  a  small  excess  error,  but  the  convergence  is  slower.  We 
have  studied  one  scheme  with  changing  step  size  for  each  tap,  analogous  to  the  adaptive 
delta-modulation,  and  showed  that  the  approach  provides  fast  convergence  initially  and 
a  small  final  error  [cl7]. 


5.  Spectral  Estimation 

A  great  many  problems  of  extraction  information  from  sensor  gathered  data 
involves  the  central  step  of  estimating  the  spectrum  of  some  data  sequences.  It  is  shown 
that  decimation  can  be  applied  to  a  number  of  spectral  estimation  methods  to  improve 
the  resolution  and/or  to  reduce  computation.  The  reduction  in  computation  is  especially 
significant  in  dealing  with  multidimensional  signals  because  of  the  burdensome  computa¬ 
tion  [j3,c5,cl3j. 

Although  in  principle,  much  of  the  known  results  in  1-D  spectral  estimation  can  be 
extended  to  2-D,  the  actual  carrying  out  of  these  extensions  are  usually  not  straightfor¬ 
ward.  Explicit  expressions  of  spectral  estimates  using  periodogram  with  the  Bartlett 
window,  the  maximum  likelihood  method  (MLM),  and  different  linear  prediction  (LP) 
models  are  derived  for  input  signal  consisting  of  a  finite  number  of  sinusoids  in  white 
noise.  These  expressions  are  useful  in  the  analytical  investigation  of  the  question  of 
resolving  closely  located  sinusoidal  signals.  Spurious  and  splitting  peaks  occur  in  all  spec¬ 
tra  using  LP  modeling,  especially  for  high  SNR  and/or  the  model  order.  It  is  shown  that 
this  problem  can  be  overcome  by  using  a  special  combination  of  the  LP  spectra  [j  13]. 


6.  Single  Chip  VLSI  Implementation  of  Digital  Filters  , 

As  integrated  circuit  technology  enters  the  very  large  scale  integration  (VLSI)  era, 
there  is  a  considerable  increase  in  the  activity  of  implementing  digital  signal  processors  in 
a  single  VLSI  chip.  Several  special  purpose  structures  that  implement  bit  serial  recursive 
and  nonrecursive  digital  filters  have  been  developed.  The  input  and  output  data  rate  of 


these  structures  is  one  bit  per  clock  cycle.  Our  efforts  have  been  directed  toward  simple 

and  regular  schemes  that  exhibit  high  word  rate  and  are  efficient  in  chip  area  utilization 
(jl0,jll,c7j. 
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